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'Survey Apparatus and Method 1 



The present invention relates to survey apparatus and 
method and particularly, but not exclusively, to a 
survey apparatus for, and a method of, creating a three 
6 dimensional image . 

I conventional survey equipment typically measures the 
9 distance, bearing and inclination angle to a target 
10 (such as a tree, electricity pylon or the like) or a 

1X target area, with reference to the position of a user. 

12 While this information is useful, it would be 

13 advantageous to create a three-dimensional (3D) image 

14 of the target and/or target area. 

16 in addition, conventional sighting devices which are 

17 US ed to select a target to be surveyed often result ,n 

18 false surveys being made as the target is often not 

19 correctly identified. 



20 
21 
22 



There are a number of conventional techniques which are 
capable of generating a three-dimensional (3D) image 

23 from photographs. One such technique is 

24 stereophotography (SP) - SP uses two simultaneous 

25 images taken by two cameras positioned at fixed points. 



\ 
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The two fixed points are precisely spaced apart: along a 
baseline distance. 

However, this conventional technique has a number of 
associated di advantages - Firstly, the pictures are 
not direct to digital, which creates difficulties in 
manipulating the images after they have been taken. 
The image* typically require to be or t ho -corrected and 
the method itself is generally slow and can be 
expensive due to the precision cameras required. 

According to a first aspect of the present invention 
there is provided survey apparatus comprising an 
waging device, a range finder, and a processor capable 
of receiving and processing image and range signals to 
construct a three-dimensional image from said signals. 

According to a second aspect of the present invention 
there is provided a method of generating a three- 
dimensional image of a target area, the method 
comprising the steps of providing an imaging device, 
providing a range finder, operating the imaging device 
to provide an image of the target area, and 
subsequently measuring the distance to each of a 
plurality of points by scanning the range finder at 
preset intervals relating to the points. 

The imaging device is preferably a camera, typically a 
digital video camera, and preferably a charge -coupled 
device (CCD) video camera. Alternatively, the camera 
may comprise a digital camera. The camera is 
preferably capable of zoom functions. This allows 
targets which may be some distance from the apparatus 
to be viewed more accurately and/or remotely. 

The apparatus typically includes a display device to 



t 



31-08-99 17:05 

3 1-AUG-99 16 : 58 FROM = 




P. 05 



R-049 



Job-835 



5/ 3E 



21 
22 
23 
24 
25 
26 



28 
29 
30 
31 
32 



34 
35 
36 



allow a user to view a target area using the imaging 
device The display device typically comprises a VGA 
eyepiece monitor, such as a liquid-crystal display 
(LCD) or flat panel display. The display device may 
alternatively comprise a VGA monitor. This offers the 
advantage that an image of the target may be viewed by 
the user to ensure that the correct target has been 
selected. Also, the survey apparatus may be operated 
remotely using the camera to view the target area. 

The apparatus preferably includes a pan and tilt unit 
for panning and tilting of the range finder and/or 



1 
2 
3 
4 

5 

6 

7 

8 

9 
10 
11 

]_2 j_ w-k. — 

13 camera. The pan and tilt unit typically comprises a 

14 first motor for panning of the range finder and/or 

15 
16 
17 
18 
19 



camera, and a second motor for tilting of the range 
finder and/or camera. The pan and tilt unit typically 
includes first and second digital encoders for 
measuring the angles of pan and tilt respectively. The 
first and second motors are typically controlled by the 



20 processor. The outputs of the first and second 

encoders is typically fed to the processor. This 



provides a feedback loop wherein the motors are 
operated to pan and tilt the range finder and/or camera 
through the generated horizontal and vertical angles. 
The encoders may then be used to check the angles to 
ensure that the range finder and/or camera were panned 
27 and tilted through the correct angles. 

The image is preferably digitised, wherein the image 
comprises a plurality of pixels. Optionally, the image 
may be a captured image. The target is typically 
selected by selecting a plurality of pixels around the 
33 target, using, for example, a mouse pointer. This 

produces x and y coordinates for the target pixels and 
defines a target area eg a building or a part thereof . 



I 
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Typically, the range finder is preferably a laser range 
finder. Preferably, the laser range finder is bore- 
sighted with the camera. This, in conjunction with the 
eyepiece monitor used to identify the target area, 
offers the advantage that the user can be sure that the 
target area he has selected will be captured by the 
camera, in addition, any subsequent calculations made, 
by the processor do not require an offset between the 
camera and the range finder to be considered. 

Preferably, the survey apparatus includes a compass and 
an inclinometer and/or gyroscope. These allow the 
bearing and angle of inclination to the target to be 
measured. - These are preferably digitised to provide 
data to the processor. 

optionally, the survey apparatus further includes a 
position fixing system for identifying the geographical 
position of the apparatus. The position fixing system 
is preferably a Global Positioning System (GPS) which 
typically includes a Differential Global Positioning 
System (DGPS) . This provides the advantage that the 
approximate position of the user can be recorded (and 
thus the position of the target using the measurements 
from the range finder and compass, where used. 
Preferably, the GPS/DGPS facilitates the time of the 
survey to be recorded. 

The survey apparatus is typically mounted on a mounting 
device. The mounting device typically comprises 
headgear which may be worn on the head of a user. TJ 
headgear typically comprises a hard-hat type helmet. 



The 



34 within a housing. The housing is cypicany ^ 

35 device. Optionally, the mounting device may be a 



36 



aevice . wyw^wi*6*j.*jr f — — — — 

tripod stand or a platform which forms part of an 
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elevation system, wherein the survey apparatus is 
elevated to allow larger areas to be surveyed. 

Optionally, the apparatus may be operated by remote 
control . 

The compass is preferably a digital fluxgate compass. 

The survey apparatus is typically controlled by an 
input device. The input device is typxcally used to 
1X activate the surveying apparatus, and may be a 

keyboard, keypad, penpad or the like. Typically the 
input device facilitates operation of a particular 
function of the apparatus. The input device 13 
typically interfaced to the processor via a standard 



1 

2 
3 
4 

5 control . 

6 
7 

8 

9 

XO input device 



12 
13 
14 
15 

16 keyboard input . 

H The GPS/DGPS is preferably integrally moulded within 

19 the helmet. m - 

20 The method typically Includes the additional step of 
L selecting the target area to be surveyed us.ng the 

22 imaging device. 

24 The method typically includes any one, eome or all of 

25 the further steps of 

26 obtaining a focal length of the camera ; 

27 obtaining a field of view of the camera ; 

Z calculating the principal distance of the camera; 

obtaining the horizontal offset and vertical 

30 offset between an axis of the camera and an ax.s of the 

T 2 '""calculating the horizontal and vertical offsets in 

terms of pixels; . 

calculating the difference between the horizontal 
and vertical offsets in terms of pixel and the x and y 



34 
35 
36 



coordinates of the target pixel; and 
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calculating the horizontal and vertical angles. 

optionally, the method typically includes one. see or 
all of the further steps of 

instructing the pan and tilt unit to pan and tilt 
the range finder and/or camera through the vertical and 

" e Tricing that the angles through vhich the range 
finder and/or camera are moved is correct; 

obtaining horizontal and/or vertical correction 
angles by subtracting the measured «~ i ?»"\ a ^ 
vertical angles from the calculated horizontal and 

15 vertical angles; 

adjusting tl 
and/or camera if necessary; and 

• ^ ™ae finder to obtain the range to 
activating the range rmaex 



10 

11 

12 
13 
14 

ical angj.es>,- 

16 adjuring the pan and tilt of the range finder 

17 
18 

19 the target. 
20 
21 

22 correlating uic - . . 

^ . ^rh t>ixel . this 

23 

24 generates a set of x, jr — — t-y^e 

25 the pixel points which may be used to generate a three 

26 



27 
28 
29 



32 
33 



Preferably, the method includes the * dd ™Y"Ll 
correcting the position of the pixels xn ^ 
picture with the measured distance to each P-el Thx, 
, Mt of X . V and z co-ordinates for all of 



dimensional image of the target area. 

Embodiments of the present invention .hall now be 
« described, by way of exampXe only, with reference to 
30 the accompanying drawings in which:- 
?° Pig i is a schematic representation of an xmage 

capture and laser transmitter and receiver unit *n 
accordance with, and for use with, the present 



^4 invention; 

35 Fig . 2 shows schematically a first embodiment of 

36 survey apparatus; 



3 1 
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Fig. 3 shows an exploded view of the survey 
apparatus of Fig. 2 in more detail; 
Pig. 4 shows a simplified schematic illustration 
of a digital encoder; 

Fig . 5 schematically shows the survey apparatus of 
Figs 2 and 3 in use; 

Fig 6 is a schematic representation of the 
display produced on a computer screen of a freeze 
frame image produced by a digital camera; 
Fig. 7 is a simplified schematic diagram of xnsxde 

* a digital camera; 
Fig 8 is a simplified diagram illustrating how a 
principal distance (PD) may be calculated; 
Fig 9 is a simplified diagram illustrating the 
offset between the laser and the camera in use; 
Fig 10 is a schematic representation illustratxng 
a horizontal offset H effset outwith the camera; 
Fig- 11 i» - schematic representation illustratxng 
a horizontal distance l x in terms of pixels, 
corresponding to H ee£set . within the camera; 
Fig. 12 is a simplified diagram of a freeze frame 
image showing an object; 

Fig 13 is a schematic representation illustratxng 
the relationship between a horizontal distance d., 
a principal distance PD and an angle 9; 
Pig. 14 is a simplified diagram illustrating the 
principle of calculating pixel x and y co- 
ordinates from horizontal and vertical angles of 
and range to the pixel; 

Fig- 15 is a simplified diagram illustratxng the 

relationship between horizontal and vertical 

angles of and range to the pixel and three 

dimensional co-ordinates of the pixel ; 

Fig- 16 is a print of the triangular framework 

used to recreate a 3D image of a bitmap 

photograph; 



3 ^^^^^ 
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Fig. 17 shows a print of a 3D image which used a 
bitmap photograph superimposed on the framework of 
Fig. 16; 

Fig 18 is a representation of an alternative 
hunting device for the survey apparatus according 
to a first aspect of the present invent ion ; 
Fig 19a is a schematic representation of a 
vehicle provided with an elevating arm and survey 
apparatus showing the position of the apparatus 
when the vehicle is moving ; 

Fig 19b is a schematic representation of the 
vehicle of Fig. 19a with the apparatus deployed on 
the arm; 

Fig 19c is a schematic representation of the 
vehicle of Figs 19a and 19b on a slope with the 
apparatus deployed on the arm;- 

Figs 20a and 20b are respective rear and sxde 
views of the survey apparatus deployed on the arm,- 
Figs 21a and 21b are respective side and plan 



20 elevations of the vehicle of Figs 15a to 15c 

illustrating the survey apparatus being used to 



profile the ground in front of the vehicle; 
Fig- 22 is a schematic view of a second embodiment 
of a mounting device ; 

Figs 23 to 27 show a hand-held housing for the 
survey apparatus according to a first aspect of 

27 the present invention,- and 

28 Figs 28 to 30 show the hand-held housing of Figs 

23 to 27 in use. 



Referring to the drawings. Fig- 1 shows a schematic 
representation of an image capture and laser 
transmitter and receiver unit 10 which forms part of 
the survey apparatus in accordance with a first aspect 
of the present invention- Unit 10 includes a laser 12 
(which typically forms part of a laser range finder) , 
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X whereby the laser 12 generates a beam of laser light 
14 The laser 12 is typically an invisible, eyesafe, 



gallium arsenide (GaAs) diode laser which emits a beam 
typically in the infra-red (ie invisible) spectrum. 
The laser 12 is typically externally triggered and xs 
typically capable of measuring distances up to, or in 



3 
4 
5 
6 

7 excess of, 1000 metres (1 km). 

8 
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The beam 14 is reflected by a part-silvered prism 16 m 
a first direction substantially perpendicular to the 
direction of the initial beam 14, thereby creating a 
transmit beam 18- The transmit beam 18 enters a series 
of transmitter optics 20 which collimates the transmit 
beam 18 into a target beam 22. The target beam 22 as 
reflected by a target (schematically shown in Fig. l as 
24) and is returned as a reflected beam 26- The 
reflected beam 26 is collected by a series of receiver 
optics 28 and directs it to a laser light detector 30. 
The axes of the transmit and receiver optics 20, 28 are 
calibrated to be coincident at infinity. 

Signals from the detector 30 are sent to a processor 
(not shown in Fig. 1), the processor typically forming 
part of a computer. The processor calculates the 
distance from the unit 10 to the target 24 using a 
time-of-flight principle. Thus, by dividing the time 
taken for the light to reach the target 24 and be 
reflected back to the detector 30 by two, the distance 
to the target 24 may be calculated. 

A digital video camera 32 is bore-sighted with the 
laser 12 (using the part-silvered prism 16) . The 
camera 32 is preferably a complementary metal-oxide 
silicon (CMOS) camera which is formed on a silicon 
chip. The chip generally includes all the necessary 
drive circuitry for the camera. It should be noted 
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t hat .he camera 32 need not: be bore-sighted ^ 
laser 12. where the camera 32 is not bore-sighted with 
the laser 12, the axis of the laser 12 will be offset 
from the axis of the camera 32 in the x and/or y 



5 directions. The offset between these axes can be 

6 calculated and the survey apparatus calibrated (eg 



7 

8 

9 
10 
11 
12 
13 
14 
15 

16 a 



using software) to take account of these offsets 
However, where the camera 32 and the laser 12 are hpre- 
si ghted (as in Fig. 1) there is no requirement to take 
account of the offset in any subsequent calculations. 
The -camera 32 is advantageously capable of zoom 
functions as this facilitates selection of targets at 
distances up to, or in excess of, l km. 

The transmit optics 20 serve a dual purpose and act as 
a lens for the camera 32- Thus, light which enters the 
17 transmit optics 20 is collated and directed to the ^ 
11 camera 32 (shown schematically at 34) thereby producing 
" an image of the target 24 at the camera 32. The image 

20 which the camera 32 receives is digitised and sent to a 

21 processor (not shown in Fig- 1) - It will be 

22 appreciated that a separate lens may be provided for 
the camera 32 if required. 

Referring now to Figs 2 and 3, Fig. 2 shows 
schematically a first embodiment of survey apparatus 
100 mounted for movement in x and y directions (xe pan 
and tilt) , and Fig. 3 shows an exploded view of the 
survey apparatus 100 of Fig. 2 in more detail. 

Referring firstly to Fig. 2, the image capture and 
laser transmitter and receiver unit 10 (Fig. 1) is 
typically mounted within a casing 50. The casing 50 is 
typically mounted to a U-shaped yoke 52, yoke 52 being 

35 coupled to a vertical shaft 54 . Shaft 54 is *otat:ably 

36 mounted to facilitate rotational movement (indicated by 



t 
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The target area is aligned with the graticule typically 
using a small circle (not shown) or a cross as a guade . 

The user 154 then fires the apparatus 150 using an 
appropriate key or button on the input device 172. The 
computer initiates the camera 32 which captures a 
digital image of the target area and scans the laser 12 
to provide a 3D image of the target area as previously 
described. It should be noted that the panning and 
tilting of the laser 12 is not achieved by motors 60, 
68 as in the Fig. 2 embodiment- In this example, the 
part-silvered prism 16 can be moved to scan the laser 
over the target to provide range information for each 



1 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 

X4 pixel within the target. 
15 
16 



in addition, measurements of the various parameters 

17 such as bearing and incline to the target area are 

18 recorded, digitised and incorporated into the 

19 calculations made by the computer. The global position 

. -, _t__ ^ i ^-p Vic measurement is also 

20 



of the user 154 and the time of the measurement 
21 recorded from the GPS/DGPS 158. 

22 
23 
24 



The calculated and/or measured data is then sent from 
the computer to the monitor 168 and is displayed m a 
window of the image by refreshing the data therein. 
This allows the user 154 to see the measured data and 
confirm that the correct target area has been 
identified and accurately shot by reference to the 
freeze frame image and the overlaid data window and 
30 reticule. 

The user 154 may then save either the data, image or 
both to the memory in the computer using an appropriate 
push button (not shown) on the input device 172. 
Multiple measurements of this nature may be recorded, 
for each pixel, thus giving 3D images of different 



t 
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3 (ie pan) - ***** -~ • 

4 thus the yoke 52 and casing 50) is controlled by a 

5 motor 60 coupled to the shaft 54, typically via a 

6 

7 

8 

9 
10 
11 
12 
13 



arr ow 56 in Fig. 2) of the casing 50 xn a 
pl ane (indicated by axis 58) which is the x-dxreocxon 
(ie Pan) - The rotational movement of the shaft 54 (and 



gearbox (not shovm in Fig. 2). The operatxon of the 
motor 60 is controlled by the computer. 

The angle of rotation of the casing 50 in the 
horizontal plane (ie panning of the unit 10 in the x- 
direction) is measured accurately by a first dxgxtal 
encoder 62, attached to the shaft 54 in a known manner, 
which measures the angular displacement of the casxng 

14 50 (and thus the transmit laser beam 22) xn the x- 

15 direction- 

Similarly, the yoke 52 allows the casing 50 (and thus 
the transmit laser beam 22) to be displaced in the y- 
direction as indicated by arrow 64. The casing 50 xs 
mounted to the yoke 52 via a horizontal shaft 66. 
Shaft 66 is rotatably mounted to facilitate rotatxonal 
movement (indicated by arrow 64 in Fig. 2) of the 
23 casing 50 in a vertical plane (indicated by axxs 68) 
which is the y-direction (ie tilt) . The rotational 
movement of the shaft 66 (and thus the yoke 52 and 
casing 50) is controlled by a motor 68 coupled to the 
shaft 56, typically via a gearbox (not shown in Fxg. 



16 
17 
18 
19 
20 
21 
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24 
25 
26 

28 2) . The operation of the motor 66 is controlled by the 

29 computer - 
30 
31 
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33 
34 



The angle of rotation of the casing 50 in the vertxcal 
plane (ie tilting of the unit 10 in the y-direction) xs 
measured accurately by a second digital encoder 70, 
attached to shaft 66 in a known manner, which measures 

35 the angular displacement of the casing 50 (and thus the 

36 transmit laser beam 22) in the y-direction. Thus, the 
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Referring to Fig. 3, there is shown in more detail the 
apparatus of Fig. 2. It should be noted that the 
casing 50 which houses the image capture and laser 
transmitter and receiver unit 10 is not provided with a 
separate camera lens 72 (as in Fig. 2). It should also 
be noted that the casing 50 in Fig. 3 is mounted to 
facilitate rotational movement in the x-direction 
(pan) , but can be manually tilted in the y-direction 
(tilt) or can be adapted to the configuration shown in 
Fig. 2 for motorised pan and tilt. 

As can be seen more clearly in Pig. 3, the casing 50 is 
mounted to the U-shaped yoke 52. The yoke 52 is 
coupled to the shaft 54 using any conventional means 
such as screws 80. The shaft 54 is driven by the 
stepper motor 60 via a worm/ wheel drive gearbox 82. 
The digital encoder 62 is provided underneath a plate 
84 through which the shaft 54 passes and to which the 
gearbox/motor assembly is attached. Plate 84 also 
includes a rotary gear assembly 86 which is driven by 
the motor 60 via the worm gearbox 82 to facilitate 
rotational movement of the shaft 54. 

The motor, gearbox and shaft assembly is mounted within 
an aluminium casing 86, the casing 86 also having a 
rack 88 mounted therein- The rack 88 contains the 
necessary electronic circuitry for driving and 
controlling the operation of the survey apparatus, and 
includes a stepper motor driver board 90, a laser 
control board 92 and an interface board 94 . 

The first and second digital encoders 62, 70 may be of 
any conventional type, such as Moir Fringe, barcode or 
mask. Moir fringe type encoders are typically used as 
they are generally more accurate. Fig. 4 shows a 
simplified schematic illustration of a digital encoder, 
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generally designated 110. Encoder HO typically 
I copses a casing 112 in which a disc 114 is rotary 
3 m ounted. The disc 11, is provided with a patte rn and 

is typically at least partially translucent. The type 
of pattern defined on the disc 114 determines the type 
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5 
6 
7 
8 
9 
10 



of encoder . 



A light emitting diode (!*» 116 is suspended above the 
disc 114 and emits a light beam (typically collated 
by a lens (not shown) which shines through the disc 
xl 114. The light emitted by the LED 116 is <^ ted ^ * 
12 detector, typically a cell array 118 A. ^ dxsc 114 

a conjunction with the shaft to which it is 
number of electrical outputs are generated 

.IT — y lift 



13 rotates (in conjunction with the shaft to which it 

^ ^L:^ -e^disc 114 »V - cell array 11. 

16 which detects the light passing through the 

17 from the *ED 116. These types of encoders usually have 

18 two output channels (only one shown in Fig. 4) and the 
phase relationship between the two signals can be used 
to determine the direction of rotation of the disc 114 . 



19 
20 
21 
22 
23 

24 on Tine gisw - , 

25 generated by the cell array 118 in response to the 
le pattern on the disc 114- These pulses can be counted 
2 2 6 7 La. 9 iven that one pulse ^ 
28 
29 
30 

31 in use, unc uiij-i. — - , ^ , 

32 by an input device such as a push button, keyboard 
oenpad or the like- when the apparatus is triggered, 



The encoder 110 produces a pulse output per unit of 
revolution. Thus, as the disc 114 rotates, the pattern 
on the disc 114 causes electrical pulses to be 



and, given that one puise i» y ^^~ 

degree of rotation, the angular rotation of the disc 
114 and thus the shaft 54 can be calculated. 

in use, the unit 10 is typically externally triggered 



^ Denpad or the 1 ike . 

11 L c.™ra 32 captures » digitised image of the target 
35 ara.. The digitised image is mad. up of a P^ 11 ^ 



36 



area, wj.^^- — — -> . ^ 

of pixels, the exact number of which is dependent upon 
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x the si,e of the image produced by the camera Each 

2 pixel has an associated x and y co-ordinate which 

3 relate to individual positions in the target area. The 
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4 processor is then used to sequentially scan t«l.»r 
» (by moving the part-silvered prism 16 accordingly 
1 Y . . tr. CB In the Pig. -5 embodiment) 



or by using the motors 60, 68 in the Fig. 
to measure the distance (range, to each successive 
point in the target area given by the X and y co- 
ordinates of the digitised image. This can then be 
US ed to create three-dimensional -^^T^"^* 
and •*> to allo» a three-dimensional image o£ the target 
area to be produced, as will be described. 

rig. 5 shows the survey apparatus 100 (schematically 
represented in Fig. 5 but shown more clearly in Figs » 
« and 3) in us-. The apparatus 100 is controlled and 

17 operated using software installed on the 

18 (shown schematically at 120) via a cable 122. 
" system or other remote or hardwired control. 
" Z the target is displayed on the computer screen using 

the camera 32 (Fig. 1) and is schematically shown as 
image 124 in Fig. =. When the image 124 of th. target 
ere! of interest is viewed on the screen, the user of 
the apparatus 100 instructs the camera 32 (included as 
the app^xc* freeze frame image 

part of the apparatus 100) to take a freez 
of the target area. The freeze frame image 124 s a 
digital image made up of a plurality of pxxels * 
6 L a schematic representation of the display produced 
on the computer screen of the freeze frame image 124. 
Th e image 124 is typically divided into an array of 
pixels, with the image containing, for example, 200 by 



32 200 pixels in the array. 

33 
34 
35 



36 



Each pixel within the array has an x and y co- ordinate 
associated with it using, for example, the centre C of 
the picture as a reference point. Thus, each pixel 



\ 
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32 
33 



within, the digital image can be individually addressed 
using these x and y co-ordinates. 

The individual addresses for each pixel allow the user 
to select a particular object (for example a tree 126) 
within the digital image 124- The tree 126 can be 
selected using a mouse pointer tot example where the 
mouse pointer is moved around the pixels of ^ 
image Z movement of a conventional mouse provided with 
the computer in a known manner- The x and y co- 
ordinates of each pixel may be displayed on the screen 
as the mouse pointer is moved around the image 
Clicking the mouse button with the pointer on the tree 
126 selects a particular pixel 128 within the array 
which is identified by its x and y coordinates. 

The computer is then used to calculate the horizontal 
angle H A and the vertical angle V A (Fig- 6) . The 
horizontal angle H A and the vertical angle V A are the 
relative angles between the centre point C of the image 
and the pixel 128, as schematically shown in Fag- 6- 

The methodology for calculating the horizontal angle H A 
and the vertical angle V A from the pixel x, y co- 
ordinates is as follows. Fig- 7 is a simplified 
schematic diagram of inside the earner. 32 which shows 
the camera lens 72 and a charge -coup led device (CCD) 
array 130. The camera 32 is typically a zoom camera 
which therefore has a number of focal lengths which 
vary as the lens 72 is moved towards and away from the 



Referring to Fig. 7, the angles of horizontal and 
34 vertical views, or the field of view in the horizontal 
and vertical direction e H , 6 V <9 V not shown in Fig- 7) 
can be calibrated and calculated at different focal 
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! lengths of the camera 32. For simplicity, it is 

2 assumed that the CCD array 130 is square, and thus the 

3 field of view in the horizontal and vertical directions 

4 6 H , 6 V will be the same, and thus only the field of view 

5 in the horizontal direction e H will be considered. The 

6 methodology described below considers one zoom posxtxon 

7 only . 



8 
9 
10 
11 
12 
13 
14 



Having calculated (or otherwise obtained eg from the 
specification of the camera 32) the field of view in 
the horizontal direction 6 H then the principal distance 
PD (in pixels) can be calculated. The principal 
distance PD is defined as the distance from the plane 
of the lens 72 to the image plane (ie the plane of the 
15 CCD array 130) . 

17 Referring to Fig. 8, if the image width on the CCD 

18 array is defined as H H , then using basic trigonometry 

19 tanCe H /2) =H R /(2PD). Thus, 

PD = H R / (2 (tan(6 H /2) ) ) 



21 
22 
23 
24 
25 
26 
27 
28 
29 
30 



If the distance between each pixel in the image 124 xn 
a certain unit (ie millimetres) is known, then the 
principal distance PD can be converted into a distance 
in terms of pixels. For example, if the field of view 
in the horizontal and vertical angles e H< ©v is, for 
example 10°, and the image contains 200 by 200 pixels, 
then moving one twentieth of a degree in the x or y 
direction is the equivalent of moving one pixel xn the 
31 x or y direction. 

when initially using the apparatus 100, the camera 32 
is used to take a calibration freeze frame image and 
the laser 12 is activated to return the range R to the 
centre point C of the image. However, the laser axis 
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is typically offset from the camera axis. The 
horizontal and vesical offsets between the laser axis 
and the camera axis when the freeze frame image ib 
taken are defined as H of£set and V offset and are known. 
Knowing the range R and the hori 2 ontal and vertical 
offsets >W, V offset allows the offset hori.ont al and 
7 vertical distances l x and l y in tertns of P^els to be 

calculated. Referring to Fig. 9, the centre point C of 
th e image 124 taken by the camera 32 and the laser spot 
13 2 where the transmit laser beam 22 hits the target 
area, is typically offset by the horizontal and vertical 
12 distances l x and l y - 

" Fi9 10 is * schematic representation illustrating the 
U horizontal offset >W outwith the camera 32. and Fig. 
,6 11 is a schematic representation illustrating the 
" horizontal distance 1, in terms of pixels, correspond^ 
« to within the camera 32. Referring to Figs 10 



18 to H oflJte t/ 

19 and 11 and using basic trigonometry, 

20 
21 

22 and. 



23 

24 Thus, 



and it follows that 



25 
26 
27 
28 
29 

30 

31 

32 

33 

34 

35 object. 
36 



tan 6 - H of£set /R 
1^ = PD(tan e) 
sec /R) 

l y = PD (V of fact /R) 



if the range to a certain object within the target area 
(such as the tree 126 in Fig. 6) is required, then the 
computer must calculate the horizontal and vertical 
angles H A , H v through which the casing 50 and thus the 
laser beam 22 must be moved in order to target the 
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The user selects the particular pixel (relating to the 
object of interest) within the image using a mouse 
pointer. In Fig- 12, the selected object is 
represented by pixel A which has coordinates <x, y) , 
and the laser spot 132 has coordinates (1*, l y > 
calculated (eg by the computer 120) using the previous 
method. The coordinates (x, y) of point A are already 
known (by the computer 120) using the coordinates of 
the pixel array of the image. 

If the horizontal distance between pixel A and the 
laser spot 132 is defined as d*, and similarly the 
vertical distance between pixel A and the laser spot 
14 132 is defined as dy, then 
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d^ = x - l x 
dy - Y - ly 



and it follows that the horizontal and vertical angles 
H A , v A can be calculated as 



H A = inverse tan (d^/PD) 



V A = inverse tan (dy/PD) 



Referring back to Fig. 2, having calculated the 
horizontal and vertical angles H A , V A through wh.ch the 
casing 50 must be rotated to measure the range to the 
object A, the computer 120 instructs the motor 60 to 
32 pan through an angle of H A and simultaneously instructs 
Che motor 68 to tilt through an angle of V ft . Thus, the 



A 1 

A 



transmit laser baam 22 is directed at the object 
selected by the user to determine the range to it. 
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1 However, the motors 60, 68 are not directly coupled to 

2 th « shafts 54, 66 (but via respective gearboxes) and 

3 thus can have errors which results in the laser beam 22 
not being directed precisely at the object A- However, 
the encoders 62, 70 can be used to measure more 
precisely the angles H A and V A through which the casing 
50 was panned and tilted. If there is a difference 
between the measured angles H A and V A and the angles 
which were calculated as above, the computer can 
correct: for this and can pan the casing 50 through an 
angle H AC which is the difference between the calculated 
angle H A and the measured angle H A , and similarly tilt 
the casing 50 through an angle which is the 
difference between the calculated angle V A and the 
measured angle V A . The process can then be repeated by 
using the encoders 62, 70 to check that the casing 50 
has been panned and tilted through the angles H AC and 
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18 v If there is a difference again, then the process 

19 can be repeated to further correct for the errors 

20 
21 
22 
23 

25 Referring again to Fig. 6, to obtain a three 

26 dimensional (3D) image of the tree 126, the user can 
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can be repeated w j.^^^ 

introduced. This iteration process can be continued 
until the output from the encoders 62. 70 corresponds 
to the correct angles H A and V A . The laser 12 is then 
fired to give the range to the object A. 



select a number of pixels around the outline of the 
tree 126 This selection limits the number of points 
which are used to create a 3D image. It should be 
noted however, that a 3D representation of the whole 
image 124 can be created. 

Having selected the outline of the target (ie tree 
126) , the software provided on the computer 120 
instructs the motors 60, 68 to pan and tilt the unit 10 
through respective horizontal and vertical angles H A . V, 
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corresponding to the pixels within the tree 126 (or the 
entire image 124 as required) - The same iterative 
process as described above can be used to ensure that 
the laser 12 is accurately directed to each of the 
pixels sequentially- At each pixel, the laser 12 is 
activated to obtain the range R to each of the pixels 
within the tree 126, as previously described. 

9 Once the horizontal and vertical angles H A , V A and the 
10 range R of each of the pixels is known, the processor 
within the computer 120 can then be used to calculate 
the 3D co-ordinates of the pixels . within the tree 126 
to recreate a 3D image of the tree 126. 

Referring to Fig. 14, the central laser spot 132 has an 
offset 1, and l y as described above, and also has 
horizontal and vertical angles H e , V 0 and range R.- 
Determination of the pixel x and y coordinates p„ P y 
for the point A which has horizontal and vertical 
angles H, V and range R, can be done as follows using 
basic trigonometry. It should be noted that the field 
of view in the horizontal and vertical directions e B , 
6 the principal distance PD and the horizontal and 
vertical distances 1, and l y are either all known or can 
be calculated as described above - 
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l v = pDtan(V-V 0 ) 



l x = PDtan (H-H Q ) 
and 



29 p y - Xy 



30 

31 It thus follows that 

32 
33 
34 
35 
36 



p x - l x + PDtan (H-H 0 ) 
and 

p y = l y + PDtan (V-V 0 > 
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Thereafter, the 3D coordinates X. y. - for the point A 
ITbe calculated, as will be described with reference 



1 

2 

3 to Fig- 15- 

4 

5 Using trigonometry , 

6 

7 

8 

9 
10 
11 
12 

14 the pixels within the target (ie tree «. or ™age 

15 124 ) . An array of pixel co-ordinates p». P„ and the 
corresponding 3D coordinates X. y. * can I» created and 

^ . __.^„ -ion ^=»-n used to 



x = RcosVcosH 
y = -RcosVsinH 

and 
2 = RsinV 



These calculations can then be repeated for each pixel 
(defined by Px , P y ) to give 3D coordinates £ or _ each of 



r 7 i™:;:: ^^^"^^ - can * e use d to 

18 Plot the 3D coordinates using appropriate software. 

19 Appendix A shows an exemplary array of pixel -co- 

20 ordinate* p„ P y and the corresponding 3D coordinates x. 
H y, z of a bitmap image which can be used to generate a 
22 3D image . 
23 



Once the 3D coordinates have been plotted, the software 
then generates a profile of the 3D image using 
triangles to connect each of the 3D coordinates 
together, as shown in Fig. 16- Pig- 1« x. a print of 
the triangular framework used to recreate a 3D .mage of 
a bitmap photograph. The bitmap image (ie the digital 
image taken by the camera 32) is then superimposed on 
the triangulated image to construct a 3D image of the 
target (ie tree 126 or image 124). Fig. 17 shows a 
33 print of a 3D image which used a bitmap photograph 

33 print ui z> , , lg T he 3D image 

34 superimposed on the framework of Fig. 16- s 

35 of the target can typically be viewed from all angles 

36 Ling the software. Thus, the user can effectively 
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walk around the tree 126. However, this may require a 
number of photographs <ie digital bitmap images taken 
by the camera 32) at different angles which can then be 
superimposed upon one another to create a full 360° 3D 

5 image- It should be noted that even when using only 

6 one photograph, the user can manipulate the 3D image to 

7 look at the tree 126 from all angles. 



8 
9 

10 

11 

12 

13 

14 

15 

16 

17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 



30 
31 
32 
33 
34 
35 
36 



It should also be noted that having a bitmap (colour) 
image of the tree 126 (and image 124) allows accurate 
(true) colours to be assigned to each pixel within the 
image. Conventionally, colours are assigned from a 
palette which may not be the true and original colours. 



The software may also be capable of allowing the user 
to select two points within the tree 126 and 
calculating the horizontal and vertical distances 
between the two points. Thus, it is possible for the 
user to determine, for example, the height of the tree 
by using the mouse to select a pixel at the top and 
bottom of the tree 126. If a building is plotted in 3D 
using the above methodology, the software can be used 
to determine the height, width and depth of the 
building, and also other parameters such as the length 
of a window, the height of a door and the like. To 
enable the used to select points more accurately, the 
software is advantageously provided with zoom 
2 8 capabilities. 

29 , 

The software may also be capable of plotting the 
profile of the tree using gradiented colours to show 
the horizontal distance, vertical distance and/or range 
to each of the pixels within the tree 126 or image 124. 

Additionally, the software may be capable of allowing 
the user to select one or more points whereby a profile 
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of the tree 126 in the plane selected can be shown. 

through one particular point within the image can also 
be plotted. It is also possible for the x, y and z 
axes to be superimposed on the image, and directional 
axes (ie north, south, east and west) can also be 
superimposed upon the image, 

instead of superimposing the bitmap (digital) ***** 
over the triangular wireframe, the software may be used 
to create a shaded image of the target and may also be 
capable of changing the position of the light which 
illuminates the target. 

It will also be appreciated that the software can 
generate x, y and/or z contours which may be 
superimposed over the image- 

Referring back to Fig- 5, the apparatus 100 can _ 
optionally include a Global Positioning System (GPS) 
(not shown) . GPS is a satellite navigation system 
which provides a three-dimensional position of the GPS 
receiver (in this case mounted as part of the survey 
apparatus 100) and thus the position of the survey 
apparatus 100- The GPS is used to calculate the 
position of the apparatus 100 anywhere « the world to 
within approximately ± 25 metres. The GPS calculates 
the position of the apparatus 100 locally using 
radio/satellite broadcasts which send differential 

, mc ,t--r-o The GPS can also be 
correction signals to ± 1 metre. me w» 

used to record the time of all measured data to 1 

microsecond * 

The apparatus 100 advantageously includes an 
inclinometer (not shown) and a fluxgate compass (not 
shown) , both of which would be mounted within the 
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casing 50 (Fig. 2). The f luxgate compass 
6ig nal which gives a faring to the target and 
inclinometer generates a signal which g.ves the ncUne 
angle to the target. These signals are P"**"* 1 * 
digitised so that they are in a machine-readable for, 
for direct manipulation by the computer 120. 

Thus, in addition to being used to find ranges to 
specific targets, the survey apparatus may also be used 
to determine the position of objects, such as 
electricity pylons, buildings, trees or other man-made 
or natural structures. The GPS system can be used to 
13 determine the position of the apparatus 100 anywhere *n 
X4 the world, which can be recorded. Optionally, the 
f luxgate compass within the casing 50 measures the 
oearlng to the target, which can be used to determine 
Position of the target using the reading from the 
GPS system and the reading from the f luxgate compass. 
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The positional information, the bearing and the 
inclination to the target can optionally be 



It should also be noted that the encoders 62, 70 may be 
used to determine the bearing to the target instead of 
the f luxgate compass. In this case, if the encoder is 
27 given an absolute reference, such as th. ^ to an 
Electricity tower or other prominent landmark which is 
either Known or can be calculated, then the angle 
relative to the reference bearing can be calculated 
using the outputs from the encoders 62, 70, thus giving 
the bearing to the target- 

In addition, the position of the apparatus and the 
calculated position of the target could be on 
a map displayed on the computer screen so that the 
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accuracy of the map can be checked. This would also 
allow more accurate maps to be drawn. 



1 
2 

3 18 shows an alternative embodiment of a mounting 



4 Fig 

5 device for the surveying apparatus gener^y 

6 150. The apparatus ISO includes a hard-hat type helmet 

v 152 The helmet 152 may be replaced by any suitable 

8 form of headgear, but is used to give a user 154 some 

9 form of protection during use. This is advantageous 
10 where the user 154 is working in hazardous conditions, 

10 . ™- t-^e like. The 
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such as on a building site, quarry or the like, 
helmet 152 is typically held in place on the head of 
the user 154 using a chin strap 156. 

Mounted within the helmet 152, and preferably 
integrally moulded therein, is a Global Positioning 
System (GPS) 158. The GPS 158 is a system which 
provides a three-dimensional position of the GPS 
receiver (in this case mounted within the helmet 152 on 
the user 154) and thus the position of the user 154- 
The GPS 158 is used to calculate the position of the 
user 154 anywhere in the world to within approximately 
+ 25 metres. The DGPS calculates the position of the 
24 user 154 locally using radio/satellite broadcasts which 
send differential correction signals to t 1 metre The 
GPS 158 can also be used to record the time of all 
measured data to 1 microsecond. 

The GPS 158 is coupled to a computer (similar to 
computer 120 in Fig. 5) via a serial port. The 
computer may be located in a backpack 160. shown 
schematically in Fig. 18. or may be a portable 
computer, such as a laptop. The backpack 160 haS * 
power source, such as a battery pack 162, either formed 
integrally therewith, or as an external unit. 
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Mounted on the helmet 152 is a housing 164 which 
encloses the range finder (as shown in Fig- 1> , the 
video camera 32, an inclinometer (not shown) and a 
fluxgate compass (not shown) - Signals from the range 
finder, camera 32, compass and inclinometer are fed to 
the computer in the backpack 160 V ia a wire harness 



The fluxgate compass generates a signal which gives a 
bearing to the target and the inclinometer generates a 
signal which gives the incline angle to the target. 
These signals are preferably digitised so that they are 
in a machine-readable form for direct manipulation by 
14 the computer - 

The video camera 32 is preferably a charge -coupled 
device (CCD) camera. This type of camera operates 
digitally and allows it to be directly interfaced to 
the computer in the backpack 160. Signals from the 
camera 32 are typically input to the computer via a 
video card. The camera 32 may be, for example, a six- 
times magnification, monochrome camera with laser 
23 transmitter optics. 

The view from the camera 32 is displayed on an eyepiece 
VGA monitor 168 suspended from the helmet 152 . The 
monitor 168 is coupled to the computer in the backpack 
160 via a second wire harness 170. The monitor 168 is 
used to display computer graphics and a generated 



25 
26 
27 
28 
29 

30 graphics overlay 

31 
32 



The mounting of the monitor 168 on the helmet 152 



is 



33 independent of the housing 164 and is thus ad 3 ustable 

34 to suit a plurality of individual users. A tn-axial 

35 alignment bracket (not shown) is provided for this 

36 purpose. 
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motors 60, 68 provide for panning and tilting of the 



1 

2 casing 50 



9 
10 
11 
12 
13 
14 

15 TO 



2 is 



The output of the first and second encoders 62, 70 is 
electrically coupled to the computer to provide a 
feedback loop. The feedback loop is required because 
the motors 60, 68 are typically coupled to the shafts 
o 54 66 via respective gearboxes and. are thus not m 

direct contact with the shafts 54, 66. This makes the 
movement of the casing 50 which is effected by 
operation of the motors 60, 68 less accurate. However, 
as 'the encoders 62, 70 are coupled directly to their 
respective shafts 54, 66 then the panning and tilting 
of the casing in the x- and y-directions can be 
,easured more accurately, as will be described. 

The embodiment of the image capture and laser 
transmitter and receiver unit 10 shown in Fig 
slightly different from that illustrated in Fig. 1. 
The camera 32 within unit 10 is not bore -sighted with 
the laser 12, and thus casing 50 is provided with a 
camera lens 72, a laser transmitter lens 74 and a laser 
receiver lens 76. It should be noted that the laser 
transmitter lens 74 and the camera lens 72 may be 
integrated into a single lens as illustrated in Fig. 1. 

26 Ideally, the camera lens 72, laser transmitter lens 

27 and laser receiver lens 76 would be co-axial. This 

28 could be achieved in practice by mechanically adjusting 
~~ the lenses 72, 74. 76 to make them co-axial. However, 

this is a time consuming process and the offsets 
between the lenses can be calculated and the survey 
apparatus can be calibrated to take these offsets into 
account, as will be described. This calibration is 
generally simpler and quicker than mechanically 
35 aligning the lenses 72, 74, 76. 
36 
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in use, software which is pre-loaded on the counter in 
the backpack 160 enables the user X54 to see a video 
image (provided by the camera 32) of the target on the 
monitor 168. The software can overlay the video linage 
with a sighting graticule (not shown) and any measured 
6 data in a separate window. 

It should be noted from Fig. 1 that the camera 32 and 
the laser range finder are bore-sighted. Conventxonal 
systems use an offset eyepiece sighting arrangement 
with an axis which is aligned and collimated to be 
parallel to the axis of the laser range finder. 
However, use of the camera 32 (which displays an image 
of the target area on the VGA monitor eyepiece 16 8) 
bore-sighted with the laser range finder provides the 
user 154 with an exact view of the target area using 
the camera 32. Thus, there is no need for a eollimated 
eyepiece and the user 154 can be sure that the range 
finder will be accurately directed at the target. To 
further improve accuracy, computer controlled graticule 
offsets may be generated during a calibration and 
collimation procedure to eliminate residual errors of 
alignment between the laser range finder and the camera 



7 
8 
3 

10 

11 

12 

13 

14 

15 
16 
17 
18 
19 
20 
21 
22 
23 



merit: ueuwc^x — 

24 32 These offset values may be stored in an erasable- 

25 programmable-read-only-memory (EPROM) for repetitive 

26 use. 
27 
28 
29 
30 

31 

32 

33 

34 

35 

36 



Operation of the apparatus 150 is controlled by an 
input device 172 connected to the computer via a 
keyboard input- The input device 172 typically 
comprises a keyboard, keypad, penpad or the like, and 
controls different functions of the apparatus 150. 

When an observation or survey is required of a 
particular target area, the user 154 views the target 
area using the camera 32 and the eyepiece monitor 168 
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1 target areas. These images may then be used to observe 
the target area either in real-time or later to assess 
and/or analyse any of the geographical features. 



2 
3 
4 
5 
6 



For example, one particular use would be by the 
military. During operations, a squad may be required 

7 to cross a river. The survey, apparatus may be used to 

8 create multiple 3D images of possible crossing places, 
for example by deploying the apparatus on an elevated 
platform. These would then be assessed to select the 
best location for a mobile bridge to be deployed. The 
image may be viewed locally or could be transmitted in 
a digital format to a command post or headquarters 
anywhere in the world. Use of the survey apparatus 
would result in much faster and more accurate 
observations of the geographical locations and would 
avoid having to send soldiers into the area to visually 



9 
10 
11 
12 
13 
14 
15 
16 
17 



18 assess the locations and report back- The apparatus 

19 may be deployed on an elevated platform and operated by 



20 



remote control to decrease the risk to human users in 
21 hostile situations. 

23 Referring to Figs 19a to 19c, there is shown a vehicle 

24 180 (such as a tank) which is provided with the 



apparatus 100 of Figs 2 and 3 mounted on a telescopic 
or extendable arm 182. As illustrated in Fig. 19a. the 
apparatus 100 may be completely retracted when the 
vehicle 180 is in motion, and may be stored behind an 
armoured shield 184. The casing 50 of the apparatus 



25 
26 
27 
28 

H loTwould^tllt'downwards to a horizontal attitude and 

31 the telescopic arm 182 would extend so that the 

32 apparatus 100 was substantially protected by the 

33 armoured shield 184 . 

35 When the area to be surveyed is reached, the vehicle is 

36 stopped and the apparatus 100 deployed on the 



08-99 17:05 P. 33 R-049 Job-685 



SS 17'BS FROMs 




PAGE 3 3/3E 



31 



telescopic arm 182 by reversing the procedure described 
above, as illustrated in Fig. 19b. The telescopic ar, 
182 is preferably mounted on a rotation joint 186 so 
that the apparatus 100 can be rotated through 360- as 
indicated by arrow 188 in the enlarged portion of Fig. 
19b A motor 190 is coupled to the rotation joint 186 
to facilitate rotation of the joint 186.. The apparatus 
8 100 can typically be raised to a height of 

approximately 15 metres or more, depending upon the 
construction of the arm 182. 

The 'particular configuration shown in Figs 19a and 19b 
can accommodate large angles of roll and pitch of the 
vehicle, such as that shown in Fig. 19c In Fig. 19c, 
the vehicle 180 is stationary on a slope 192 and has 
been rolled through an angle indicated by arrow 184 in 

17 Fig 19c- The user or the computer can correct for the 

18 angle of roll 184 by moving the arm 182 until the 

19 inclinometer indicates that the apparatus 100 is level . 

20 A level 198 (Figs 20a, 20b) may be provided on the base 

21 of the apparatus 100 if required. 

22 
23 
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Figs 20a and 20b are front and side elevations of the 

24 apparatus 100 mounted on the arm 182. As can be seen 

25 from Figs 20a and 20b, the arm 182 can be rotated 



through 360- as indicated by arrow 196 in Fig. 
The apparatus 100 is mounted on a pan and tilt head 200 
to facilitate panning and tilting of the apparatus 100. 

Servo motors within the pan and tilt head 200 pan and 
tilt the head 200 into the plane of roll and pitch of 
the vehicle 180 (Fig. 19c). Thereafter, the motors 60, 
68 of the apparatus 100 pan and tilt the apparatus 100 
until it is level, using the level indicator 198 as a 



26 
27 
28 
29 
30 

31 

32 

33 

34 

35 guide. 
36 
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Further electronic . levels (not shown) within the 
apparatus 100 can measure any residual dislevelment and 
this can be corrected for in the software before any 
measurements are taken. 

A particular application of the apparatus 100 deployed 
on a vehicle 180 would be in a military operation. The 
apparatus 100 can be deployed remotely on the arm 182 
and used to survey the area surrounding the vehicle 180 



1 
2 
3 
4 
5 
6 
7 
8 

!0 tTcreate a 3D real-time image of the terrain 

11 
12 
13 
14 
15 
16 
17 

18 

19 

20 

21 

22 

23 
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26 



Alternatively, or additionally, the computer 120 could 
be provided with a ground modelling software package 
wherein the user selects a number of key targets within 
the area using the method described above, and finds 
the range and bearing to. height of and global position 
of (if required) these targets. The software package 
will then plot these points, including any heights 
which a GPS 202 (Figs 20a and 20b) can generate, and 
in-f ill or morph the remaining background using digital 
images captured by the camera 32 to produce a 3D image 
of the terrain, as described above. 

The surveying operation can be done discretely and in a 
very short time compared with conventional survey 
techniques and provides a real-time 3D image of the 

27 terrain. Once the terrain has been modelled, design 

28 templates of equipment carried by the vehicle 180 (or 

29 any other vehicle, aircraft etc) can be overlayed over 

30 the image to assess which type of equipment is required 

31 to cross the obstacle, such as a river- 

33 conventional techniques would typically require to 

34 deploy a number of soldiers to survey the area manually 

35 and report back. However, with the apparatus 100 

36 deployed on the vehicle 180 the survey can be done 
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1 quicker, more accurately and more safely, without 
substantial risk to human life- 

It is possible to conduct multiple surveys with the 
vehicle 180 in one or more locations, with the data 
from each survey being integrated to give a more 
accurate overall survey of the surrounding area. 
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Furthermore, if the arm 182 was disposed at the front 
of the vehicle 160 as shown in Figs 21a and 21b, the 
apparatus 100 can be used to check the profile of the 
ground in front of the vehicle 180. Thus, the profile 
of the ground could be shown in 3D which would allow 
the driver of the vehicle {or other personnel) to 
assess the terrain and warn of any dangers or 



Alternatively, or additionally, the software on the 
computer 12 0 could be used to generate a head-up video 
display to which the driver of the vehicle 180 could 
refer The heading of the tank (measured by the 
fluxgate compass) could also be displayed, with the 
range to and height of the ground (and any 
obstructions) in front of the vehicle 180 also being 
displayed- The height displayed could be the height 
relative to the vehicles' position, or could be the 
absolute height obtained from the GPS 202. 

Another application of the survey apparatus 110 would 
be to capture images of electricity pylons for example 
by targeting each individually and saving the data for 
future reference (for example to allow their positions 
on a map to be plotted or checked) or to observe them 
in 3D to check for any faults or the like. 

in addition to providing the 3D image of the target 
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1 area, the computer may also calculate the position of 

2 the target area using the GPS/DGPS 158 (Fig. 18) - The 

3 position of the user 154 is recorded using- the GPS/DGPS 

4 158, and by using the measurements such as bearing and 

5 inclination to the target area, the position of the 

6 target area may thus be calculated. 
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The apparatus provides a 3D image of the target area 
which, in a geographical format, may be used to update 
map information and/or object dimensions and positions. 
The software may overlay and annotate the measured 
information on background maps which may be stored, for 
example, on compact-disc-read-only-memory (CD-ROM) or 
any other -data base, such as Ordinance Survey maps. 



Using a separate function on the input device 172, the 
user can change the image on the monitor 168 to show 
either a plot of the user's position (measured by the 
GPS/DGPS 158) superimposed on the retrieved data base 
map, or to view updated maps and/or object dimensions 
and' positions derived from the measurements taken by 
22 the apparatus 100. 
23 

Fig. 22 shows a concept design of an alternative 
apparatus 210. The apparatus 210 is mounted on a head 
band 212 which rests on the head of a user 214. 
Mounted on the headband 212 is a housing 224 which is 
attached to the headband 212- The housing 224 encloses 
the survey apparatus 100 (Fig. 5) as previously 
described. This particular embodiment incorporates an 



31 eyepiece monitor 250 into the housing 224. 



33 Figs 23 to 30 show a hand-held housing for the survey 

34 apparatus. The hand-held device 300 includes an 

35 eyepiece 310 which is used to select the target area. 

36 Device 3 00 incudes an image capture and laser 
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transmitter and receiver unit 10 similar to that shown 
2 schematically in Fig- 1- 
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In use, a user 314 (Figs 28 to 30) puts the eyepiece 
310 to his eye and visualises the target through a lens 
312 when the target has been visualised, a fire 
button 314 is depressed which initiates the camera 32 
(Fig. 1) to take a digital (two-dimensional) image of 
the target, which can be displayed on a small LCD 
screen 316. The laser range finder can then be used to 
determine the range to each pixel using the methodology 
described herein to allow a 3D image to be produced 
It should be noted that the hand-held device 300 need 
not be capable of processing the 3D image. The range 
to each pixel can be recorded and stored in a file for 
transfer to a computer (provided with the appropriate 
software) which may be used to reproduce the 3D image. 
The device 300 is typically provided with a suitable 
interface for downloading, or may be provided with an 
a ltemative storage means such as an EPROM which may be 
removed from the device as required, or a floppy disc 
22 derive for example. 

Thus, there is provided a survey apparatus which is 
capable of producing 3D images, both in real-time and 
for later viewing. The apparatus may be mounted m a 
hand-held device or on the head of a user. The 
apparatus may also be mounted on a tripod stand or on 
an elevated platform. Furthermore, the images may be 
stored or electronically transmitted for subsequent 
retrieval and analysis . 



23 
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The apparatus is simpler, cheaper and has the 
capability to be mora accurate than current technics 

35 used to produce 3D images - 

36 
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x Modifications and improvements may be made to the 
foregoing without departing from the scope of the 
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3 invention 
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This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 

□ faded text or drawing 
^Blurred or illegible text or drawing 

□ skewed/slanted images 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: __ . — " 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 
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